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Description 

METHOD AND RELATED CIRCUIT FOR 
DETECTING BLACK FRAMES IN VIDEO 

SIGNAL 

Background of Invention 

[0001] 1. Field of the Invention 

[0002] The present invention provides a method for detecting 

commercial-spot frames, and more particularly, a method 
and related circuit for detecting black frames with a few 
but representative pixels. 

[0003] 2. Description of the Prior Art 

[0004] Video programs from mass media provide news, knowl- 
edge, and entertainments for audiences. However, consid- 
ering commercial pursuits, the programs are often alter- 
nated with commercials, which breaks coherence and 
wastes time. Therefore, how to filter out commercials 
within a video program becomes one of the most impor- 
tant issues for development in modern information tech- 



nology. 

[0005] Please refer to Fig.l, which illustrates a schematic diagram 
of a video signal 10. The motion (dynamic) video signal 10 
includes parts of a program and commercials. The video 
signal 10 can be regarded as a combination of a series of 
frames each showing an image. Playing the frames with a 
proper frequency (frame rate) can show the dynamic 
video. In the video signal 10, the frames Fal to FaN, and 
Fdl to FdQ are different parts of the program, while the 
frames Fbl to FbM, and Fcl to FcP are two commercial 
spots. In general, many countries have ruled that an inter- 
val between a part of the program and a commercial spot 
should be included in the video signal 10, so that a black 
frame sequence is introduced for separating the program 
from the commercial spot. This so-called a black frame is 
a full black frame, and combining such black frames 
forms a black frame sequence, such as sequences from 
frames Bla to Bib, frames B2a to B2b, and frames B3a to 
B3b shown in Fig.l. 

[0006] Therefore, as long as the black frames can be detected in 
the video signal 10, the separated program can be recon- 
structed into a whole program by filtering out the com- 
mercial spots. As those skilled in the art recognize, each 



frame can be regarded as a combination of a plurality of 
pixels each having a tint and a brightness. Pixels of a 
black frame are all (basically uniformly) black, so that dif- 
ferences between any two pixels of the black frame are 
quite little. As a result, a prior art detection method is to 
calculate a brightness mean and a brightness variance of 
the pixels of each frame for determining whether a frame 
is a black frame with small brightness mean and variance. 
However, the above method requires a lot of calculations 
and system resources, and so the efficiency of black frame 
detection is low. 

[0007] Another prior art black frame detection method is to ana- 
lyze histograms of all pixels of a frame, which sorts the 
pixels into different bins according to brightness of each 
pixel, and calculates a brightness mean and a brightness 
variance of the pixels in a low-brightness bin. Although 
this method only deals with the pixels in the low- 
brightness bin, it has to analyze histograms of all the pix- 
els of the frame, equivalently calculating all the pixels. 
Therefore, the efficiency of black frame detection cannot 

be improved. 
Summary of Invention 

[0008] It is therefore a primary objective of the claimed invention 



to provide a method and related circuit for detecting blacl< 
frames. 

[0009] According to the claimed invention, a method for detect- 
ing a black frame of a video signal includes: (a) receiving a 
frame data from the video signal. The frame data includes 
a plurality of pixel data each corresponding to a pixel of 
an image, (b) processing a setting step for setting a pat- 
tern including a plurality of reference positions, (c) pro- 
cessing a sampling step for determining reference pixels 
according to positions of the pixels in the image. A pixel 
of the image is determined as a reference pixel if the po- 
sition of the pixel equals a reference position. The pattern 
limits the number of reference pixels to be smaller than 
the number of pixels of the image, and keeps the number 
of reference pixels from changing as the pixel data corre- 
sponding to the pixels of the image change; and (d) pro- 
cessing a decision step for determining whether the pixel 
data corresponding to the pixels of the image fit a default 
according to the pixel data corresponding to the reference 
pixels. 

[0010] These and other objectives of the claimed invention will 
no doubt become obvious to those of ordinary skill in the 
art after reading the following detailed description of the 



preferred embodiment that is illustrated in tlie various 

figures and drawings. 
Brief Description of Drawings 

[0011] Fig.l illustrates a schematic diagram of a prior art video 
signal. 

[0012] Fig. 2 illustrates a block diagram of a processing circuit of 

the present invention. 
[0013] Fig. 3 illustrates a frame data diagram of the processing 

circuit in Fig. 2. 

[0014] Fig. 4 illustrates a schematic diagram of the processing 
circuit in Fig. 2 when processing black frame detection. 

[0015] Fig. 5 to Fig. 7 illustrate schematic diagrams of the pro- 
cessing circuit in Fig. 2 when selecting references pixels 
according to different patterns. 

[0016] Fig. 8 illustrates a schematic diagram of a process of one- 
tier black frame detection. 

[0017] Fig. 9 illustrates a schematic diagram of a process of 
multi-tier black frame detection. 

[0018] Fig. 10 illustrates a schematic diagram of a processing cir- 
cuit for detecting a black frame with frequency-domain 
data. 

[0019] Fig. 11 illustrates a frame data diagram of the processing 
circuit in Fig. 10. 



[0020] Fig. 12 illustrates a schematic diagram of the processing 

circuit in Fig. 10 when processing black frame detection.. 
Detailed Description 



[0021] Please refer to Fig. 2, which illustrates a block diagram of a 
present invention processing circuit 20. The processing 
circuit 20 includes a receiver 22, a sampling module 24, a 
setting module 26, and a decision module 28. The re- 
ceiver 22 includes decoding and demodulation circuits for 
drawing a video signal 32B out from a signal 32A. The 
signal 32A is provided by a mass media or a storage de- 
vice (such as a VCD-player, DVD-player or a hard disk), 
while the video signal 32B includes a plurality of frame 
data each corresponding to a frame. The setting module 
26 stores one or more patterns PT each corresponding to 
a plurality of reference positions. When detecting each 
frame in the video signal 32B, the sampling module 24 
samples a frame according to the patterns PT, so as to 
determine reference pixels, which are the pixels of the 
frame having positions matching the reference positions. 
The decision module 28 can determine whether the frame 
is a black frame based on statistic characters of the refer- 
ence pixels. In a preferred embodiment, the decision 
module 28 includes a mean decision module 30A and a 



deviation decision module BOB for calculating a mean MO 
and a deviation VO (or a variance) according to the refer- 
ence pixels, so as to determine the black frame with the 
mean MO and the deviation VO. 
[0022] Please refer to Fig. 3 (also Fig. 2), which illustrates a timing 
diagram of the signals of the processing circuit 20. As 
mentioned above, the video signal 32B includes frame 
data FDl, FD2, etc. corresponding to frames Fl, F2, etc. 
Each frame data includes a plurality of pixel data for 
recording corresponding information, such as tint, bright- 
ness, etc. For example, the frame Fl includes pixels pxll, 
pxl2, pxlB, etc, and accordingly, the frame data FDl in- 
cludes pixel data pdllA, pdllB, and pdllC for describ- 
ing the tint and brightness of the pixel pxll, and pixel 
data pdl2A, pdl2B, pdl2C for describing the pixel pxl2. 
That is, the pixel data pdllA, pdllB, and pdllC are RGB 
(red, green, blue) quantities if the video signal 32B is de- 
fined by RGB, or the pixel data pdllA, pdllB, and pdllG 
are Y, RY, BY signals if the video signal 32B is defined 
chromatically. 

[0023] Please refer to Fig. 4 (also Fig. 2), which illustrates a 

schematic diagram of the present invention when pro- 
cessing the black frame detection. The pattern PT stored 



in the setting module 26 is diagonal. When the processing 
circuit 20 determines whether a frame F of the video sig- 
nal 32B is a black frame, the sampling module 24 selects 
pixels pxDl, pxD2, pxD3 to pxDN as reference pixels ac- 
cording to diagonal of the pattern FT, and reads pixel data 
(such as brightness signals Y of the reference pixels) 
pdDl, pdD2, pdD3 to pdDN from the video signal 32B. 
Then, the mean decision module 30A of the decision 
module 28 calculates a mean MO according to the pixel 
data pdDl to pdDN, while the deviation decision module 
30B calculates a deviation VO for determining a deviation 
degree of each pixel data from the mean MO, such as a 
variance. 

[0024] After calculating the mean MO and the deviation VO, the 
decision module 28 determines that the frame F is a black 
frame if the mean MO and the deviation VO are smaller 
than a threshold mean and a threshold deviation meaning 
that the reference pixels pxDl to pxDN are low bright- 
ness, and vary little. 

[0025] As those skilled in the art should recognize, as long as the 
pattern PT includes both sides and the middle of the 
frame F, the sampling module 24 can determine enough 
pixels to represent the frame F. Please refer to Fig. 5 (also 



Fig. 2), which illustrates a plurality of embodiments of the 
pattern PT, labeled as PTl to PT15. Lines of the patterns 
PTl to PT15 shows positions of the reference pixels, such 
as diagonals, crosscuts, midlines, or their combinations. 
Take the patterns PT4 and PTl 5 for example; the sam- 
pling module 24 selects the reference pixels along the 
midline of the frame F according to the pattern PT4, or 
along the midline, crosscut, and two diagonals of the 
frame F according to the pattern PTl 5. Therefore, the ref- 
erence pixels selected from a frame are fewer than the 
exact pixels of the frame, but enough to represent the 
frame, so that efficiency of black frame detection can be 
increased. 

[0026] In addition, the above-mentioned threshold mean and de- 
viation can be dynamically changed as the frame changes. 
For example, after the reference pixels are determined, 
the present invention can set the threshold mean accord- 
ing to each pixel data of the reference pixels, such as the 
70% value of the maximum pixel data, or the difference 
between the maximum and the minimum pixel data. 

[0027] Please refer to Fig. 6, which illustrates a schematic diagram 
of a pattern PTlb. The pattern PTlb derived from the pat- 
tern PTl in Fig. 5 locates pixel positions in the diagonal of 



a frame with a specific interval, so as to determine blacic 
frames with fewer reference pixels. Basically, the patterns 
PTl to PT15 in Fig. 5 can derive such advanced sampling 
with specific intervals. 

[0028] Other than the linear patterns in Fig. 4 to Fig. 6, please re- 
fer to Fig. 7, which illustrates a schematic diagram of a 
pattern PT16. The pattern PT16 indicates the reference 
positions with a plurality of uniform spread rectangles (as 
hatched areas shown in Fig. 7), so that the sampling mod- 
ule 24 selects the reference pixels from the frame F ac- 
cording to the rectangles of the pattern PT16 as intersec- 
tion areas shown in Fig. 7. Certainly, with changing the 
size of each rectangle of the pattern PT16, other patterns 
can be derived from the pattern PT16, such as a deriva- 
tional pattern having uniform spread rectangles each cor- 
responding to only one pixel. 

[0029] Please refer to Fig. 8, which illustrates a flowchart of a 
process 100 of black frame detection. The process 100 
includes the following steps: 

[0030] Step 102: start a black frame detection. 

[0031] Step 104: select reference pixels from a frame F according 

to a first pattern. 
[0032] Step 106: calculate statistic characters of the reference 



pixels, such as a mean and a deviation, and determining 
whether the mean and the deviation are smaller than a 
threshold mean and a threshold deviation. If true, the 
process 100 proceeds to step 110, otherwise it proceeds 
to step 108. 

[0033] Step 108: the frame F is not a black frame. 
[0034] Step 110: the frame F is a black frame . 
[0035] Step 112: finish. 

[0036] Please refer to Fig. 9, which illustrates a flowchart of a 

two-tier black frame detection of a process 200. The pro- 
cess 200 is different from the process 100, which is so- 
called a one-tier black frame detection. The process 200 
includes the following steps: 

[0037] Step 202: start a two-tier black frame detection. 

[0038] Step 204: select reference pixels (designated as first- 
group reference pixels) from a frame F according to a first 
pattern. 

[0039] Step 206: calculate statistic characters of the first-group 
reference pixels, such as a mean and a deviation 
(first-group mean and deviation), and determine whether 
the first-group mean and the first-group deviation are 
smaller than a threshold mean and a threshold deviation. 



If true, the process 200 proceeds to step 214, otherwise it 
proceeds to step 208. 

[0040] Step 208: select reference pixels (designated as second- 
group reference pixels) from the frame F according to a 
second pattern. The second pattern can include more ref- 
erence pixels than the first pattern, so as to calculate the 
statistic characters more accurately. 

[0041] Step 210: calculate statistic characters of the second- 
group reference pixels, such as a mean and a deviation 
(second-group mean and deviation), and determine 
whether the second-group mean and the second-group 
deviation are smaller than a threshold mean and a thresh- 
old deviation. If true, the process 200 proceeds to step 
214, otherwise it proceeds to step 212. 

[0042] Step 212: the frame F is a black frame. 

[0043] Step 214: the frame F is not a black frame. 
[0044] Step 216: finish. 

[0045] The process 200 can be compatible with the process 100 
if the process 200 proceeds to step 212 rather than step 
208 in step 206 when the first-group mean and the first- 
group deviation are not smaller than the threshold mean 
and the threshold deviation. In addition, the threshold 



mean and the threshold deviation in step 212 can be dif- 
ferent from those in step 206. Other than the two-tier de- 
tection, three or more tier detection can also be derived 
from Fig. 8 and Fig. 9. 
[0046] As those skilled in the art should recognize, in order to 
decrease transmission bandwidth and storage space for a 
video signal, MPEG (Motion Picture Experts Croup) com- 
pression protocol, for example, is utilized, so that each 
frame of the video signal is divided into a plurality of 
blocks (each block includes 8*8 pixels, for example) each 
undergoing a frequency-domain transformation (such as 
two-dimensional discrete cosine transformation), so as to 
transform the pixel data of each block into data in the fre- 
quency domain. Then, a compressed video signal is gen- 
erated by taking a variable length coding for the data in 
the frequency domain. Oppositely, when decompressing 
the compressed video signal, the data in the frequency 
domain is decoded with a variable length decoding for an 
inverse frequency-domain transformation (such as two- 
dimensional discrete cosine inverse transformation) into 
the pixel data, so as to reconstruct the original frame. The 
present invention can detect a black frame after the vari- 
able length decoding, but before the inverse frequency-do- 



main transformation. 

[0047] Please refer to Fig. 10, wliich illustrates a schematic dia- 
gram of a processing circuit 40. The processing circuit 40 
includes a receiver 42, a sampling module 46, a setting 
module 48, and a decision module 50. The receiver 42 in- 
cludes a decoding circuit for extracting a frequency-do- 
main video signal 54B, which stores the data in the fre- 
quency domain of each block, from a compressed signal 
54A. The setting module 48 stores one or more patterns 
PTf for the sampling module 46 to select the reference 
blocks from a frame, while the decision module 50 calcu- 
lates statistic characters according to the data in the fre- 
quency domain (especially the low-frequency data or di- 
rect current data) corresponding to the reference blocks 
for determining whether the frame is a black frame. In ad- 
dition, the decision module 50 can include a mean deci- 
sion module 52A and a deviation decision module 52B for 
calculating a mean Mf and a deviation Vf according to the 
data corresponding to the reference blocks. 

[0048] Please refer to Fig. 11 (also Fig. 10), which illustrates a tim- 
ing diagram of signals of the processing circuit 40. The 
video signal 54B includes a plurality of frequency-domain 
frame data FDfl, FDf2, etc. each capable of being trans- 



formed into a frame. In Fig. 11, a frame Fml correspond- 
ing to tlie frequency-domain frame data FDfl includes a 
plurality of blocks Bkl, Bk2 to BkN each including a plu- 
rality of pixels arranged in a matrix. As mentioned above, 
each pixel data corresponding to a pixel of a block will 
undergo a frequency-domain transformation, so that fre- 
quency-domain data Cel, Ce2 to CeQ stored in the fre- 
quency-domain frame data FDfl are obtained after trans- 
forming the pixel data of the block Bkl into the frequency 
domain. Similarly, frequency-domain data CeNl to CeNQ 
are obtained after transforming the pixel data of the block 
BkN into the frequency domain. 
[0049] Please refer to Fig. 12 (also Fig. 10), which illustrates a 

schematic diagram of the present invention when detect- 
ing the black frame according to the frequency-domain 
frame data of a frame F. The sampling module 46 selects 
blocks BkDl to BkDL as the reference blocks according to 
the diagonal of a pattern PTf, and draws direct-current 
data CeDl to CeDI from the blocks BkDl to BkDL. Then, 
the decision module 50 calculates the character statistics 
(such as the mean Mf and the deviation Vf) of the direct- 
current data CeDl to CeDI, so as to determine whether 
the frame F is a black frame. For example, if the mean Mf 



is smaller than a threshold mean and the deviation Vf is 
smaller than a threshold deviation, the frame F is a black 
frame. Also, the deviation Vf in Fig. 10 can be obtained by 
an absolute value calculation. 

[0050] When taking frequency-domain transformation of pixel 
data of each pixel of a block, the pixel data are multiplied 
by different weights, equivalently. Particularly, the direct- 
current data are summaries of the pixel data of the 
blocks. Therefore, the direct-current data corresponding 
to a reference block corresponds to the summary of the 
pixel data corresponding to the reference block. In other 
words, with statistic characters of direct-current data cor- 
responding to the reference blocks, the black frame can 
be detected according to the mean and the deviation of 
the direct-current data. 

[0051] In addition, when detecting the black frame with the fre- 
quency-domain transformation, the patterns in Fig. 5, 
Fig. 6, and Fig. 7 can be used, and so can the multi-tier de- 
tection of Fig. 9. 

[0052] When detecting the black frame, the prior art uses much 
system resources for calculating all pixels of each frame, 
but the present invention is based on a few reference pix- 
els enough to represent a frame. Therefore, the present 



invention can increase the efficiency of blacic frame detec- 
tion and decrease tlie demand on system resources. Be- 
sides, the processing circuit of Fig. 2 or Fig. 10 can be im- 
plemented with hardware, software, or firmware. 
[0053] Those sl<illed in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



